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SYSTEM AND METHOD FOR 



APPLICATION VIEWING THROUGH 



COLLABORATIVE WEB BROWSING SESSION 



Background of the Invention 



5 1. Field of the Invention 

The present invention relates generally to a system and method for browsing computer 
networks such as the World Wide Web ("Web"). More specifically, the present invention relates 
to a system and method for displaying a selected portion of a first computer display on the display 

b::r 

of one or more second computers through a collaborative Web browsing session. 
JHlO 2. Related Art 

[7 • The Internet is comprised of a vast number of world-wide interconnected computers and 

g computer networks. These interconnected computers exchange information using various services 
such as electronic mail ("email"), Gopher, telnet, file transfer protocol ("FTP"), and the Web. The 
Web allows a computer that is connected to the Internet to access data that is stored on other 

*^1 5 interconnected computers. The data available on these interconnected computers is divided up into 
segments that are colloquially referred to as "Web pages." The data collected together on a Web 
page is not restricted to a textual format. The data can be graphical, audio, moving picture, or any 

* other compatible multi-media source. Users gain access to Web pages by using an application 
program known as a "browser." Thus, an individual using a computer connected to the Internet can 
20 browse through various Web pages existing on computers around the world. 

The ubiquitous nature of the Internet facilitates its use as a business tool. Accordingly, many 
Web pages are devoted to providing product marketing information and taking sales orders. 
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Additionally, the Web can be used as a communication tool between a sales representative and a 
potential customer. For example, a collaborative Web browsing system can be used to allow a sales 
person to guide a potential customer through a predetermined set of Web pages that comprise a sales 
presentation. This is accomplished by allowing the sales person to control the potential customer's 
5 Web browser. Such a system is disclosed in United States Patent No. 5,944,791 ("the '791 patent"), 
which is hereby incorporated by reference in its entirety. 

The '791 patent provides a collaborative Web browsing system and method for allowing a 
first computer connected to the Web to cause the browsers of one or more second computers 
simultaneously connected to the Web to display certain predetermined Web pages or presentation 
PO slides as directed by the first computer. The problem is that often it is desirable for the user of the 
4= first computer ("Presenter") to be able to present to the one or more second computers ("Attendee") 
j ::f images that are not part of the predetermined presentation. 

[ s For example, if the Presenter in a collaborative Web browsing session desired to answer a 

u question from an Attendee by showing the Attendee an on-line manual reference, the Presenter 
jrtS would be unable to do so through the collaborative Web browsing session. In order for the Presenter 
yj to incorporate such a reference to an on-line manual into future sessions, the Presenter would have 
to create a Web page or a presentation slide of the particular on-line manual page and include that 
page or slide in the predetermined flow of the collaborative Web browsing session. 



20 application running on the first computer. To make such a presentation, the Presenter would be 
required to create slides or Web pages from static images of the application window prior to the 
collaborative Web browsing session. The Attendee would not be able to see the application running 



Another example of this problem arises when the Presenter desires to show the Attendee an 
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in real time. This can lead to interpretations by the Attendee of "smoke and mirror" sales techniques 
and "mock-up" applications. 

Yet another example of this problem is when the Presenter, during a collaborative Web 
browsing session, visits a Web site containing input fields. Perhaps the Presenter is demonstrating 



a loan calculator that is available on a particular Web page. As the Presenter enters information into 
fields of the loan calculator, it would be desirable to allow the Attendee to see the information 
entered by the Presenter prior to submission of the form. Currently, there is no way for the Attendee 
to see information entered by the Presenter. 

Therefore, the problem in a collaborative Web browsing session is that the Attendee cannot 
see applications running on the Presenter's computer or experience the application running on the 
Presenter's computer in real time. Furthermore, the Attendee cannot see the completed input fields 
of a form prior to its submission by the Presenter. Accordingly, it is an object of the present 
invention to address these problems inherent in a collaborative Web browsing session. 



As recognized by the present invention, it is desirable for the Presenter in a collaborative 
Web browsing session to be able to dynamically integrate the active window or a selected 
application window from the Presenter's computer into the collaborative Web browsing session. 
Additionally, it is desirable for the Presenter to be able to transmit the entire display screen from the 
Presenter's computer into the collaborative Web browsing session. Furthermore, it is desirable for 
the Presenter to be able to interject a selected portion of the display screen from the Presenter's 
computer into the collaborative Web browsing session. This would allow the Presenter, for example, 
to demonstrate a local application, display a certain page of an on-line manual, or show the 
completed fields of a Web based loan application form. Thus, as recognized by the present 
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invention, it is possible to provide a data structure on a computer readable medium that enables the 
Presenter in a collaborative Web browsing session to cause a region of the Presenter's computer 
display to be dynamically integrated into the session. 

Accordingly, an advantage of the present invention is that it provides a data structure on a 
5 computer readable medium that allows the Presenter of collaborative Web browsing session to 
integrate the active window from the Presenter's computer display into the current session. It is also 
an advantage of the present invention to provide a data structure on computer readable medium that 
allows the Presenter of a collaborative Web browsing session to integrate a specifically selected 
window from the Presenter's computer display into the current session. Another benefit of the 
clip present invention is that it provides a data structure on a computer readable medium that allows the 
=F Presenter of collaborative Web browsing session to integrate the entire display from the Presenter's 
[j;f computer display into the current session. Yet another feature of the present invention is that it 
["g provides an easy-to-use and cost-effective system and method for a Presenter of collaborative Web 
browsing session to integrate a selected region of the Presenter's computer display into the current 
15 session. 

y:| A computer program product includes a program means stored on a computer readable 

medium that is readable by a digital processing system. As intended by the present invention, the 
computer program product is realized in a machine component that causes the digital processing 
system to perform method steps to enable a first computer to direct the browser of one or more 

20 second computers. As further intended by the present invention, the computer program product is 
realized in a machine component that causes a region of a first computer's display to appear on the 
display of one or more second computers participating in a collaborative Web browsing session. 
Stated differently, a machine component establishes a computer program product for performing 
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method steps to enable a first computer to cause a second computer to display a selected region from 
the display of the first computer by transmitting an image of the region from the first computer to 
the second computer through a control site computer connected to the first and second computers 
via a computer network and a collaborative Web browsing session. 

As disclosed in detail below, the present computer performable instructions include selecting 
the desired region on the display of a first computer, capturing the intended region from the display 
of the first computer, transmitting an image of the region to the control site computer, transmitting 
the image from the control site computer to one or more second computers, and then displaying the 
image on the display of the one or more second computers. In a preferred embodiment, the image 
is displayed in a separate window on the display of the one or more second computers. The 
computer program product is also disclosed in combination with the digital processing apparatus, 
and in further combination with the computer network. 

In another aspect, a computer-implemented method is disclosed for allowing a first computer 
to cause a region of the display of the first computer participating in a collaborative Web browsing 
session to appear on the display of one or more second computers participating in the same 
collaborative Web browsing session. The method includes selecting a region from the display of a 
first computer. In alternative embodiments, the region selected may be a specific window, the 
currently active window, a selected region, or the entire display. The method also includes capturing 
the selected region of the display on the first computer. Additionally, the method includes 
transmitting an image of the region from the first computer to a control site computer that is 
connected to the first computer by a computer network and a collaborative Web browsing session. 
The method also includes transmitting the image from the control site computer to one or more 
second computers that are similarly connected to the control site computer by a computer network 
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and a collaborative Web browsing session. In a preferred embodiment, the first, second, and control 
site computers are all connected to each other through the Internet. Finally, the method includes the 
one or more second computers displaying the image received from the first computer via the control 
site computer. In alternative embodiments, the image may appear in a separate window on the 
5 display of the one or more second computers or the image may appear in the window containing a 
previously displayed image from the first computer. 

In still another aspect, a system is disclosed for allowing a first computer to cause a region 
of the display of the first computer to appear on the display of one or more second computers by 
transmitting an image of the desired region to the second computers through a control site computer 
MfO connected to the first and second computers through a computer network and a collaborative Web 



B i!; browsing session. The system includes, at the first computer, a selector for selecting a region on the 
| display of the first computer. A transmitter for transmitting an image of the region to a control site 
s j connected to the first computer by a computer network. At the one or more second computers, also 
U connected to the control site computer by computer network, a requestor for requesting new images 
H 5 from the control site computer. At the control site, a second transmitter is provided for transmitting 
*j:f notification of new images to the one or more second computers. The second transmitter 

additionally transmits images to the one or more second computers. At the one or more second 

computers, a display is provided for displaying the image received from the control site on the 

display of the one or more second computers. 
20 Brief Description of the Drawing s 

The details of the present invention, both as to its structure and operation, can best be 

understood in reference to the accompanying drawings, in which like reference numerals refer to like 

parts, and in which: 
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Figure 1 is a functional diagram depicting an operational environment according to one 
embodiment of the present invention; 

Figure 1A is a block diagram depicting an operational environment according to one 
example of the present invention; 
5 Figure 2 is a flowchart depicting an example of a method that can be used as a configuration 

process by the Presenter to configure the applet for transmitting the target display area into the 
collaborative Web browsing session; 

Figure 3 is a flowchart depicting an example of a method that can be used by the Presenter 
to capture the target display area during the collaborative Web browsing session and send it to the 
;|0 Control Server; 

!;! Figure 4 is a flowchart depicting an example of a method that can be used by the Control 

:=J Server to notify the Attendee Clients of the new image being integrated into the collaborative Web 
j browsing session; 

^ Figure 5 is a flowchart depicting an example of a method that can be used by the Attendee 

1 5 Client to display the new image being integrated into the collaborative Web browsing session; 

i.ii 

j f Figure 6 is an example of a configuration window allowing the Presenter to select the target 

region to be displayed on one or more second computers; 

Figure 7 is an example of a configuration window allowing the Presenter to select the 
keyboard combinations that cause the capture, repeat capture, and turning on and off of the automatic 
20 refresh feature; and 

Figure 8 is an example of a configuration window allowing the Presenter to set the interval 
of time between automatic captures of the selected region. 
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Detailed Description of the Preferred Embodiments of the Invention 



The present invention is directed toward a system and method for browsing computer 
networks such as the World Wide Web. More specifically, the present invention relates to a system 
and method for allowing a first computer in a collaborative Web browsing session to project a 
5 selected region of its screen onto the display of one or more second computers in the same session. 
In a preferred embodiment, the screen portion can be the active window, a selected window, the first 
computer's entire display, or any selected region of the first computer's display. 

After reading this description, it will become apparent to one of ordinary skill in the art how 
to implement the invention in alternative embodiments and alternative applications. As such, this 
jO detailed description of preferred and alternative embodiments should not be construed to limit the 
I r scope or breadth of the present invention. 

iil FIGS. 1 and 1 A are diagrams that show example collaborative Web browsing sessions. 

%! FIGS. 2, 3, 6, 7, and 8 are flowcharts and sample screens that illustrate, as embodied in the present 
invention, the configuration of the Presenter Client 110 computer and the capture of the selected 

[ lt ' s l5 image on the Presenter Client 110 computer. Additionally, FIGS. 4 and 5 represent the flow of data 

*!;? to and from the Control , Server 140 through a computer network and the presentation of the image 
on the display of the Attendee Client 120 as embodied in the present invention. Those skilled in the 
art will appreciate that the Figures illustrate the structures of logic elements such as computer 
program code elements or logic circuits that function according to this invention. Manifestly, the 
20 invention is practiced in its essential embodiment by a machine component that renders the logic 
elements in a form that instructs a digital processing apparatus (a computer) to perform a sequence 
of function steps corresponding to those shown in the figures. 
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These instructions may reside on a program storage device including a data storage medium, 
such as a computer diskette, optical disk, compact disk ("CD"), or magnetic tape. Alternatively, 
such media can also be found in semiconductor devices, on a conventional hard disk drive, electronic 
read-only memory, electronic access memory, or on any other appropriate data storage device. In 
an illustrative embodiment of the invention, the logic means are computer executable instructions 
that are written in the Java programming language. 

Referring initially to FIG. 1, a functional overview of the present invention is shown. A 
collaborative Web browsing session 100 is initiated between the Presenter Client 110 and the 
Attendee Client 120. In a preferred embodiment, this session is established over the Internet using 
the Web 130. The Presenter Client 1 10 computer and the Attendee Client 120 computer can be any 
suitable computer such as a personal computer ("PC") or a laptop computer, each having a display, 
such as a video monitor or flat panel display for presentation. Also, the Web browsers used in the 
collaborative Web browsing session by the Presenter Client 110 and the Attendee Client 120 may 
advantageously be commercial browsers such as those made by Netscape and Microsoft. 
Furthermore, it should be noted that the World Wide Web is just one example of a computer network 
that can be used with the present invention. In alternative embodiments, other types of computer 
networks can be used, including LANs, WANs, intranets, etc. Accordingly, the use of the Web 130 
as an exemplary computer network used in the explanatory examples should not be construed to 
limit the scope or breadth of the present invention. 

Referring back to FIG. 1, the collaborative Web browsing session 100 in this example 
embodiment is facilitated by the use of a Control Server 140, which includes a control module that 
enables the Presenter Client 1 10 to control the Web browser of one or more Attendee Clients 120. 
Accordingly, the Presenter Client 110 has an active control associated with its Web browser. This 



SD-132529.2 



Page 9 




Patent 
246/211 



active control is preferably a small application program referred to as an "applet." The applet 
running on the Presenter Client 110 allows the Presenter Client's 110 Web browser to communicate 
with the control module on the Control Server 140. This communication preferably takes place via 
a computer network, such as the Web 130. Similarly, the one or more Attendee Clients. 120 (only 
5 a single Attendee Client is shown in FIG. 1 for clarity) include an applet that allows the Attendee 
Client's Web browser to communicate with the control module on the Control Server 140. 
Preferably, the communication between the Presenter Client 110, the Control Server 140, and to the 
Attendee Client 120 takes place through a computer network, such as the Web 130. Thus, FIG. 1 
depicts a collaborative Web browsing session in which the Presenter Client 110 and the Attendee 

H30 Client 120 use an applet to communicate with the Control Server 140 over a network such as the 

=P« Web 130. 



j;:f FIG. 1A depicts an example of a block diagram of a collaborative Web browsing session 

H 100. In a preferred embodiment, Presenter Client 1 10 has a Selector 180 by which the Presenter 
ll Client 110 may choose the desired region of the screen to integrate into the collaborative Web 
15 browsing session 100. Additionally, the Presenter Client 1 10 has a Capturer 182 and a Transmitter 
<J!| 184 that allow the Presenter Client 1 10 to capture an image associated with the selected region and 
send it to the Control Server 140. For example, the Presenter Client 110 may use the Selector 180 
to select the active window on the Presenter Client's 110 computer. Subsequently, the Presenter 
Client 110 may use the Capturer 182 to capture the selected active window. Then, the Presenter 
20 Client 110 may use the Transmitter 184 to send an image associated with the active window to the 
Control Server 140. 

In one example embodiment, the Control Server 140 has a Receiver 186 to receive images 
sent from the Presenter Client 110. Furthermore, the Control Server 140 has, in the sample 
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embodiment, a URL Composer 188 and a Transmitter 190. The Control Server 140 may, for 
example, use the URL Composer 188 to compose a URL that allows the Attendee Client 120 to 
request the dynamically integrated image from the Presenter Client 110. Moreover, in this example, 
the Control Server 140 uses the Transmitter 190 to send the URL to the Attendee Client 120. 
5 In a preferred embodiment, the Attendee Client 120 has a corresponding Receiver 192 to 

receive the URL from the Control Server 140. Upon receipt, the Attendee Client 120, for example, 
uses its Requestor 194 to send the URL as a request to the Control Server 140. The Receiver 186 
of the Control Server 140 preferably receives the request. Upon receipt, the Control Server 140 
sends the requested image to the Attendee Client 120 using the Transmitter 190. The Attendee 
=;:J0 Client 120 preferably receives the image from the Control Server 140 with the Receiver 192 and 
11 subsequently, in one example embodiment, displays the image using its Displayer 196. In another 
H i example embodiment, the Control Server 140 receives the image from the Presenter Client 110 and 
s| directly transmits that image to the Attendee Client 120 for display by its Displayer 196. 
h [ In one example embodiment, the Presenter Client 110 establishes a collaborative Web 

L.L, 

j ;;15 browsing session 100. To initialize a session, the Presenter Client 110 transmits a user name and 
*!;: password to the Control Server 140. The Control Server 140 then determines whether the Presenter 
Client's 110 user name and password are valid. If invalid, the Control Server 140 causes a message 
to be displayed to the Presenter Client 110, indicating that the Presenter Client 110 lacks the 
necessary authority to create a session. Alternatively, if the user name and password are valid, the 
20 Control Server 140 sends the Presenter Client 110 an identification code corresponding to the 
session. Once the Control Server 140 has validated the Presenter Client 110 and sent the 
identification code, a collaborative Web browsing session 100 has been created. 
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Continuing the example, the Attendee Client 120 can join the collaborative Web browsing 
session 100 at any time after the session has been created. To join the session, the Attendee Client 
120 preferably sends to the Control Server 140 the identification code corresponding to the desired 
session. Once the Control Server 140 authenticates the identification code, it causes the previously 
5 discussed applet to be downloaded to the Attendee Client 120. Once the applet has been downloaded 
to the Attendee Client 120, the Attendee Client 120 relinquishes control of its Web browser to the 
Presenter Client 110. 

The flow of the collaborative Web browsing session 100 can take place sequentially or in 
parallel. For example, there may be more than one Presenter Client 110 participating in a 
1: ;:i0 collaborative Web browsing session 100. These additional Co-Presenter Clients 160 are secondary 
% to the Presenter Clients 110. However, for clarity and ease of understanding, most of the 

jni collaborative Web browsing sessions 100 described in this specification include a single Presenter 

t . 

\l Client 110. Examples with more than one Presenter Client 1 10 are described to particularly point 
'?••* out aspects of the present invention that are related to the primary Presenter Client 110 or the 
Hi 5 secondary Co-Presenter Clients 1 60. 

Accordingly, the flow of a collaborative Web browsing session 100 begins with the Presenter 
Client 110 sending a request to the Control Server 140. This request may be to send new visual data 
to the Attendee Clients 120. Alternatively, the request could be to exercise any of the various 
features in the collaborative Web browsing session. Such features include, but are not limited to, 
20 browsing to a new Web page, displaying a new presentation slide, diagramming on a virtual 
whiteboard, and conversing in a chat window. 

In a preferred embodiment, if the action by the Presenter Client 110 requests new visual data 
in the form of a new presentation slide, the Control Server 140 causes the Attendee Client 120 

SD-132529.2 Page 12 




Patent 
246/211 



browsers to download the requested slide. For example, prior to the collaborative Web browsing 
session 100, the Presenter may convert a PowerPoint ™ slide show into graphical images that are 
compatible with standard commercial Web browsers. Thus, when the Presenter Client's 110 request 
is for a new slide, the Control Server 140 causes the Attendee Client's 1 10 web browser to display 
5 the slide. 

On the other hand, if the request is for a new Web page, the Control Server 140 retrieves the 
requested page from the Web 130 and filters it for the Presenter Client 110 and the Attendee Client 
120. In a preferred embodiment, the first filtering process carried out by the Control Server 140 is 
for the Presenter Client 110 and causes all of the hyperlinks of the requested Web page to point back 
":;;l0 to the Control Server 140. After the requested Web page has been filtered for the Presenter Client 
j;» 1 10, the Control Server 140 causes the requested page to be downloaded to the Presenter Client 110. 
iff The second filtering process carried out by the Control Server 140 in this example embodiment is 
- I for the Attendee Client 120. This process causes all of the hyperlinks of the requested page to be 
^ disabled. After the requested Web page has been filtered for the Attendee Client 120, the Control 
['15 Server 140 causes the requested page to be downloaded to the Attendee Client 120. Thus, the 
collaborative Web browsing session 100 may flow through a series of Web pages and previously 
prepared slides that collectively comprise the session. 

During this flow of the collaborative Web browsing session 100, the Presenter Client 110 
may desire to deviate from the predetermined course of Web pages and slides. The Presenter Client 
20 110 may desire to integrate some portion of its own display into the flow of the collaborative Web 
browsing session 100. For example, the Presenter Client 110 may desire that the Attendee Client 
120 view an application window that is running locally at the Presenter Client's 110 computer. 
Therefore, in this example, rather than directing the Control Server 140 to cause the next slide or the 
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next Web page to be displayed on the Attendee Client's 120 computer, the Presenter Client 110 
directs the Control Server 140 to cause an application window from the Presenter Client's 110 
computer to be displayed on the Attendee Client's 120 computer. 

To effectuate the dynamic inclusion of a region from the Presenter Client's 110 display into 
the collaborative Web browsing session 1 00, the region is selected, captured, sent to the Control 
Server 140, and sent to the Attendee Client 120 where it is finally displayed. 

FIG. 2 is a flowchart that depicts an example configuration process that can be used on the 
Presenter Client 110 computer. Initially, the Presenter Client 110 loads an applet as illustrated in 
step 200. When selecting the capture target in a preferred embodiment as shown in step 210, the 
Presenter Client 110 may choose the entire desktop, a certain region of the display, a selected 
window, or the active window. In an example embodiment the Presenter Client 110 may select the 
desired region by clicking on a radio button in the control window. An example of a control window 
that can be used by the Presenter Client 1 10 to select the capture target is subsequently described in 



Furthermore, as portrayed by step 220, the Presenter Client 110 may select which keys will 
function as the hotkeys. In an alternative embodiment, separate hotkeys are available for a capture 
command, for a repeat capture command, and to toggle on and off the auto-refresh feature. An 
example of a control screen that can be used by the Presenter Client 1 10 to configure the hotkeys is 
subsequently described in FIG. 7. 

In one embodiment, represented in step 230, the Presenter Client 110 selects the time interval 
for the automatic refresh feature. In alternative embodiments, the Presenter Client 110 may select 
3 seconds as the interval or 3 minutes as the interval. For example, if an application on the Presenter 
Client's 110 computer was frequently changing its display screen, then the time interval would 
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preferably be shorter. An example of a control screen that the Presenter Client 110 can use to select 
the time interval for the automatic refresh feature is subsequently described in FIG. 8. When the 
capture target, hotkeys, and time interval have been selected the setup process is complete, as 
illustrated in step 240. 

Those skilled in the art will recognize that the active window in a windowing system is the 
window that has the central focus of the system. Thus, in this same example, when the Presenter 
Client 1 10 has selected the active window as the target, the desired window must become the central 
the focus of the windowing system. The focus may be shifted to the desired window, for example, 
by clicking the mouse in the desired window such that the focus of the windowing system is centered 
on the appropriate window. The application window may also become the focal point by pressing 
a certain combination of keys on the keyboard until the desired window is in focus. For example, 
using a windows based operating system, the Presenter Client 110 may cycle the focus of the 
windowing system through the available windows by pressing the [ALT]-[TAB] key combination. 
When the desired application window comes into focus, the selection is complete. 

Additionally in the selection process, the region of the screen chosen as the target by the 
Presenter Client 110 may be the active window, a specifically selected window, the entire computer 
display, or a selected portion of the computer display. In the above example, the region selected as 
the target was the active window. In another example, the region could be the entire computer 
display, colloquially referred to as the "desktop." In a preferred embodiment, the Presenter Client 
110 may enter a presentation control window to select the desktop as the target region. An example 
of a control window that can be used by the Presenter Client 110 to select the capture target is 
subsequently described in FIG. 6. Alternatively, the Presenter Client 110 may select a region of the 
display or a specific window to integrate into the session. 
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After a portion of the screen has been selected as the desired region, the region is preferably 
captured by the Presenter Client's 110 applet. For example the Presenter Client 110 may first select 
the desired region in a control window, as described above in step 210. In an example embodiment, 
after the target has been selected the Presenter Client 110 captures the target by pressing a previously 
determined combination of keys on the keyboard, referred to as a "hotkey." For example, in one 
example embodiment, the Presenter Client 110 selects the [PRINTSCREEN] key to be the hotkey 
for the capture command as described above in step 220. In such a case, when the Presenter Client 
110 pressed the [PRINTSCREEN] key, the selected target would be captured by the applet. 

In an alternative embodiment, the applet causes an ActiveX Control or Plug-In to execute 
the capture on its behalf. Another example of how the selected target may be captured is by clicking 
a predetermined button on the mouse. In a preferred embodiment, the capture command may be 
performed by simultaneously clicking the right and left mouse buttons after the desired region has 
been selected. 

When the hotkey is executed, the previously selected screen area is captured by the applet 
on the Presenter Client 110 and incorporated into the flow of the collaborative Web browsing session 
100. In a preferred embodiment, the selected and captured region of the screen is sent to the Control 
Server 140 as graphical data. For example, the Control Server 140 receives the graphical image from 
the Presenter Client 110, processes the image as part of the current collaborative Web browsing 
session, and then causes the image to be sent to the Attendee Clients 120. In the same example, each 
Attendee Client 120 receives the image from the Control Server 140 and then subsequently displays 
that image. In a preferred embodiment, the applet on the Attendee Client 120 causes the image to 
be displayed in a newly opened browser window. Alternatively, the applet may cause the image to 
be displayed in a new applet window. Continuing with the same example, the image on the display 

SD-132529.2 ^ Page 16 





Patent 
246/211 



of the Attendee Client 120 is refreshed using the same process each time the hotkey is activated by 
the Presenter Client 110. 

Yet another example of how the selected target may be captured is by instructing the 
Presenter Client 1 10 applet to automatically execute the capture. For example, the Presenter Client 
110 may enter a control window and configure the applet to automatically capture the targeted 
region, as described above in step 230. In a preferred embodiment, the applet may be instructed to 
capture the targeted region by clicking with the mouse a button labeled "Start auto-refresh" that 
appears in a control window. An example of a control window that can be used by the Presenter 
Client 1 10 to start the automatic refresh is subsequently described with reference to FIG. 8. 

In the same embodiment, once the applet has been directed to initiate the capture, the applet 
can be further configured to automatically refresh, or re-execute the capture. Thus, in a preferred 
embodiment, the Presenter Client 110 applet may repeatedly capture the selected target in 
incremental time periods. For instance, in an example embodiment, the Presenter Client 110 applet 
may be instructed to perform the capture every 3 seconds. In such an embodiment, the automatic 
capture would allow the Presenter Client 1 10 to continuously update of the selected region on the 
Attendee Client's 120 display without manual intervention. 

After the target has been selected and captured, the Presenter Client 110 applet sends the 
image to the Control Server 140 for integration into the collaborative Web browsing session 100. 
FIG. 3 is an example of a process by which the Presenter Client 110 captures the selected image and 
sends the image to the Control Server 140. In an example embodiment, the Presenter Client 110 
applet waits for the hotkey instructing it to capture the selected target, as illustrated by steps 310 and 
315. In a preferred embodiment, the hotkey capture command can be either manual or automatic. 
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In an illustrative embodiment, after the screen capture has been executed by the Presenter 
Client 110 applet in step 320, the applet performs a color quantization step to reduce the color palette 
of the captured image to 256 colors, as indicated by step 325. In step 330, the Presenter Client 1 10 
applet encodes the captured and quantized image into a graphics file format. For example, the applet 
encodes the image into the GIF format. After encoding, the Presenter Client 110 applet sends the 
image to the Control Server 140, as shown in step 335. Preferably, after the image has been captured 
and sent to the Control Server 140, the Presenter Client 110 continues to wait for more screen 
capture commands. In a preferred embodiment, as illustrated by step 340, if the Presenter Client 110 
applet receives a terminate command, the application viewing process ends as shown in step 345. 
In an example embodiment, the termination could be initiated by termination of the entire 
collaborative Web browsing session 100 or alternatively the termination could be initiated by a 
terminate capture command sent by the Presenter Client 110. 

FIG. 4 discloses an example of a process that can be used on the Control Server 140 after the 
captured image is received from the Presenter Client 110. For example, after an image is received 
from the Presenter Client 110, as shown in step 400, the Control Server 140 composes a URL 
associated with the received image as illustrated in step 410. This URL is preferably sent to each 
Attendee Client 120, as shown in step 440, and subsequently used by each Attendee Client 120 to 
request the new image as described below with reference to FIG. 5. This process is repeated for each 
image captured and sent to the Control Server 140 by the Presenter Client 1 10 or the Co-Presenter 



Once an image has been sent from the Control Server 140 to the Attendee Clients 120, the 
Attendee Client preferably displays the image. FIG. 5 is an example of a process that can be used 
to display the captured image on the computer screen of an Attendee Client 120. First, as illustrated 



Client 160. 
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in step 500, the Attendee Client 120 receives a new image URL from the Control Server 140. In a 
preferred embodiment, as shown in step 510, each Attendee Client 120 immediately sends a 
corresponding image request to the Control Server 140. As demonstrated in step 520, after sending 
the image request to the Control Server 140, the Attendee Client 120 receives the image from the 
Control Server 140. Once the image has been received from the Control Server 140, the Attendee 
Client 120 displays that image. In a preferred embodiment, as shown in step 530, the image from 
the Control Server 140 is displayed in a separate window. 

In an alternative embodiment, the separate window displaying the captured image is 
refreshed each time a capture command is executed by the Presenter Client 1 10 or by a Co-Presenter 
Client 160. In an alternative embodiment, the Presenter Client 110 and each Co-Presenter Client 160 
will have a unique separate window on the desktop of the Attendee Client 120. In such an 
embodiment, additional screen captures or refreshes by the Presenter Client 110 and the Co- 
Presenter Client 160 are sent to the corresponding unique separate windows on the Attendee Client 
120 display. 

FIG. 6 depicts an example of a control window that allows the Presenter Client 1 10 to select 
the region to be integrated into the collaborative Web browsing session 100. For example, the 
Presenter Client 110 can click the mouse on a radio button for the desktop, a specific region, a 
selected window, or the active window to target that region for inclusion in the collaborative Web 
browsing session 100, as discussed above with reference to step 210. 

FIG. 7 depicts an example of a control window that allows the Presenter Client 1 10 to select 
the keyboard combinations that will serve as the hotkeys as discussed above with reference to step 
220. For example, the Presenter Client 110 may choose to have the [PRINTSCREEN] key serve as 
the initial capture command. Additionally, in one example embodiment, the Presenter Client 110 
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may select hotkeys to repeat the capture command and also to turn on and off the automatic refresh 
feature. 

FIG. 8 depicts an example of a control window that allows the Presenter Client 1 10 to set the 
interval period for the automatic refresh feature, as discussed above with reference to step 230. In 
one example embodiment, the Presenter Client can set the refresh interval to 3 seconds. In a 
preferred embodiment, the refresh timer is set to a higher value for regions that infrequently change. 

While the particular application viewer of a collaborative Web browsing session herein 
shown and described in detail is fully capable of attaining the above described objects of this 
invention, it is to be understood that the description and drawings represent a presently preferred 
embodiment of the invention and are, as such, representatives of the subject matter which is broadly 
contemplated by the present invention. It is further understood that the scope of the present 
invention fully encompasses other embodiments that may become obvious to those skilled in the art, 
and that the scope of the present invention is accordingly limited by nothing other than the appended 
claims. 
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